Assessing outcomes for cost-utility analysis in depression : comparison of five multi-attribute utility instruments with two depression-specific outcome measures

Many mental health surveys and clinical studies do not include a multi-attribute utility instrument (MAUI) that produces quality-adjusted life-years (QALYs). There is also some question about the sensitivity of the existing utility instruments to mental health.

Evaluating public risk preferences in forest land-use choices using multi-attribute utility theory

Forest policy decisions inherently involve multiple attributes and risk and uncertainty as they largely deal with complex biological, ecological, and socio-political systems. Identifying risk preferences and quantifying their inter-relationships and tradeoffs are useful in formulating better forest policy. Often, technocrats and experts deal with risky decisions, but ideally, stakeholder risk characteristics should be explicitly considered in making policy decisions. This paper analysed societal risk preferences on public forest land-use attributes using multi-attribute utility theory (MAUT). The results indicate significant risk-averse behaviour towards old-growth forest conservation and forest-based recreation but less risk-averse behaviour towards native timber extraction. Overall, the respondents preferred a more conservative forest land-use option, which is consistent with their risk attitudes. The method provides insights into risk preferences of forest stakeholders, which could lead to better understanding of forest management conflicts. Moreover, the method explicitly distinguishes the technical and value components of the decision and is useful in unravelling public risk preferences in multiple-use forest planning situations.

Validity of the assessment of quality of life (AQoL) utility instrument in patients with operable and inoperable lung cancer

There have been few longitudinal studies of quality of life in patients with all stages of lung cancer, particularly those that have included measures of utility. The purpose of this study was to examine the psychometric properties of the Assessment of Quality of Life instrument (AQoL) in patients with lung cancer. The AQoL is a health-related quality of life questionnaire and provides a descriptive system for a multi-attribute utility instrument (MAU), so that scores can be used in cost-utility evaluations. In the present study the reliability (internal consistency) of the AQoL was examined and the concurrent validity was assessed using the Medical Outcomes 36-item Short Form Health Survey (SF-36) as the comparator instrument. The sensitivity to different health states of the AQoL and the responsiveness to change over time was also examined. A prospective, non-experimental cohort study was undertaken. Ninety-two participants with all stages of lung cancer were recruited from a tertiary multi-disciplinary lung cancer clinic. Ninety participants had non-small cell lung cancer (NSCLC) and two had limited stage small cell lung cancer. The AQOL and SF-36 surveys were administered concurrently at baseline. In patients with NSCLC the surveys were then repeated 3 and 6 months later. Correlations between the baseline AQoL summary scales and SF-36 summary scales support the divergent and convergent validity of the AQoL. Reliability was also found to be sufficient (Cronbach's Alpha = 0.76). In addition, in patients with inoperable NSCLC, baseline AQoL scores were found to be predictive of survival at 6 months in Cox proportional hazards multivariate analysis. However, the physical components summary score of the SF-36 was more sensitive to differences in health states between patients with different stages of NSCLC at 6 months of follow-up and more responsive to change over time in both operable and inoperable patients with NSCLC than the AQoL. The findings support the construct validity and reliability of the AQoL in this population. However, there remains some uncertainty about whether the AQoL has sufficient sensitivity to different health states in this population. Further studies using other MAU instruments may determine whether alternative instruments are more sensitive to different health states in individuals with lung cancer.

Analyzing evacuation decisions using multi-attribute utility theory (MAUT)

Emergency managers are faced with critical evacuation decisions. These decisions must balance conflicting objectives as well as high levels of uncertainty. Multi-Attribute Utility Theory (MAUT) provides a framework through which objective trade-offs can be analyzed to make optimal evacuation decisions. This paper is the result of data gathered during the European Commission Project, Evacuation Responsiveness by Government Organizations (ERGO) and outlines a preliminary decision model for the evacuation decision. The illustrative model identifies levels of risk at which point evacuation actions should be taken by emergency managers in a storm surge scenario with forecasts at 12 and 9 hour intervals. The results illustrate how differences in forecast precision affect the optimal evacuation decision. Additional uses for this decision model are also discussed along with improvements to the model through future ERGO data-gathering.

Construction of the descriptive system for the assessment of quality of life AQoL-6D utility instrument

Background
Multi attribute utility (MAU) instruments are used to include the health related quality of life (HRQoL) in economic evaluations of health programs. Comparative studies suggest different MAU instruments measure related but different constructs. The objective of this paper is to describe the methods employed to achieve content validity in the descriptive system of the Assessment of Quality of Life (AQoL)-6D, MAU instrument.

Methods
The AQoL program introduced the use of psychometric methods in the construction of health related MAU instruments. To develop the AQoL-6D we selected 112 items from previous research, focus groups and expert judgment and administered them to 316 members of the public and 302 hospital patients. The search for content validity across a broad spectrum of health states required both formative and reflective modelling. We employed Exploratory Factor Analysis and Structural Equation Modelling (SEM) to meet these dual requirements.

Results and Discussion
The resulting instrument employs 20 items in a multi-tier descriptive system. Latent dimension variables achieve sensitive descriptions of 6 dimensions which, in turn, combine to form a single latent QoL variable. Diagnostic statistics from the SEM analysis are exceptionally good and confirm the hypothesised structure of the model.

Conclusions
The AQoL-6D descriptive system has good psychometric properties. They imply that the instrument has achieved construct validity and provides a sensitive description of HRQoL. This means that it may be used with confidence for measuring health related quality of life and that it is a suitable basis for modelling utilities for inclusion in the economic evaluation of health programs.

Deriving a preference-based utility measure for cancer patients from the European Organisation for the Research and Treatment of Cancer's Quality of Life Questionnaire C30 : a confirmatory versus exploratory approach

Background Multi attribute utility instruments (MAUIs) are preference-based measures that comprise a health state classification system (HSCS) and a scoring algorithm that assigns a utility value to each health state in the HSCS. When developing a MAUI from a health-related quality of life (HRQOL) questionnaire, first a HSCS must be derived. This typically involves selecting a subset of domains and items because HRQOL questionnaires typically have too many items to be amendable to the valuation task required to develop the scoring algorithm for a MAUI. Currently, exploratory factor analysis (EFA) followed by Rasch analysis is recommended for deriving a MAUI from a HRQOL measure. Aim To determine whether confirmatory factor analysis (CFA) is more appropriate and efficient than EFA to derive a HSCS from the European Organisation for the Research and Treatment of Cancer’s core HRQOL questionnaire, Quality of Life Questionnaire (QLQ-C30), given its well-established domain structure. Methods QLQ-C30 (Version 3) data were collected from 356 patients receiving palliative radiotherapy for recurrent/metastatic cancer (various primary sites). The dimensional structure of the QLQ-C30 was tested with EFA and CFA, the latter informed by the established QLQ-C30 structure and views of both patients and clinicians on which are the most relevant items. Dimensions determined by EFA or CFA were then subjected to Rasch analysis. Results CFA results generally supported the proposed QLQ-C30 structure (comparative fit index =0.99, Tucker–Lewis index =0.99, root mean square error of approximation =0.04). EFA revealed fewer factors and some items cross-loaded on multiple factors. Further assessment of dimensionality with Rasch analysis allowed better alignment of the EFA dimensions with those detected by CFA. Conclusion CFA was more appropriate and efficient than EFA in producing clinically interpretable results for the HSCS for a proposed new cancer-specific MAUI. Our findings suggest that CFA should be recommended generally when deriving a preference-based measure from a HRQOL measure that has an established domain structure.

Predicting time trade-off health state valuations of adolescents in four Pacific countries using the assessment of quality-of-life (AQoL-6D) instrument

Objectives: Pacific Obesity Prevention in Communities (OPIC) is a community-based intervention project targeting adolescent obesity in Australia, New Zealand, Fiji, and Tonga. The Assessment of Quality of Life Mark 2 (AQoL-6D) instrument was completed by 15,481 adolescents to obtain a description of the quality of life associated with adolescent overweight and obesity, and a corresponding utility score for use in a cost–utility analysis of the interventions. This article describes the recalibration of this utility instrument for adolescents in each country.

Methods: The recalibration was based on country-specific time trade-off (TTO) data for 30 multiattribute health states constructed from the AQoL-6D descriptive system. Senior secondary students, in a classroom setting, responded to 10 health state scenarios each. These TTO interviews were conducted for 24 groups, comprising 279 students in the four countries resulting in 2790 completed TTO scores. The TTO scores were econometrically transformed by regressing the TTO scores upon predicted scores from the AQoL-6D to produce country-specific algorithms. The latter incorporated country-specific “corrections” to the Australian adult utility weights in the original AQoL.

Results: This article reports two methodological elements not previously reported. The first is the econometric modification of an extant multi-attribute utility instrument to accommodate cultural and other group-specific differences in preferences. The second is the use of the TTO technique with adolescents in a classroom group setting. Significant differences in utility scores were found between the four countries.

Conclusion: Statistical results indicate that the AQoL-6D can be validly used in the economic evaluation of both the OPIC interventions and other adolescent programs.

Deriving a preference-based measure for cancer using the EORTC QLQ-C30 : a confirmatory versus exploratory approach

Background: To derive preference-based measures from various condition-specific descriptive health-related quality of life (HRQOL) measures. A general 2-stage method is evolved: 1) an item from each domain of the HRQOL measure is selected to form a health state classification system (HSCS); 2) a sample of health states is valued and an algorithm derived for estimating the utility of all possible health states. The aim of this analysis was to determine whether confirmatory or exploratory factor analysis (CFA, EFA) should be used to derive a cancer-specific utility measure from the EORTC QLQ-C30. Methods: Data were collected with the QLQ-C30v3 from 356 patients receiving palliative radiotherapy for recurrent or metastatic cancer (various primary sites). The dimensional structure of the QLQ-C30 was tested with EFA and CFA, the latter based on a conceptual model (the established domain structure of the QLQ-C30: physical, role, emotional, social and cognitive functioning, plus several symptoms) and clinical considerations (views of both patients and clinicians about issues relevant to HRQOL in cancer). The dimensions determined by each method were then subjected to item response theory, including Rasch analysis. Results: CFA results generally supported the proposed conceptual model, with residual correlations requiring only minor adjustments (namely, introduction of two cross-loadings) to improve model fit (increment χ2(2) = 77.78, p < .001). Although EFA revealed a structure similar to the CFA, some items had loadings that were difficult to interpret. Further assessment of dimensionality with Rasch analysis aligned the EFA dimensions more closely with the CFA dimensions. Three items exhibited floor effects (>75% observation at lowest score), 6 exhibited misfit to the Rasch model (fit residual > 2.5), none exhibited disordered item response thresholds, 4 exhibited DIF by gender or cancer site. Upon inspection of the remaining items, three were considered relatively less clinically important than the remaining nine. Conclusions: CFA appears more appropriate than EFA, given the well-established structure of the QLQ-C30 and its clinical relevance. Further, the confirmatory approach produced more interpretable results than the exploratory approach. Other aspects of the general method remain largely the same. The revised method will be applied to a large number of data sets as part of the international and interdisciplinary project to develop a multi-attribute utility instrument for cancer (MAUCa).

Visual attention and attribute attendance in multi-attribute choice experiments

Decision strategies in multi-attribute Choice Experiments are investigated using eye-tracking. The visual attention towards, and attendance of, attributes is examined. Stated attendance is found to diverge substantively from visual attendance of attributes. However, stated and visual attendance are shown to be informative, non-overlapping sources of information about respondent utility functions when incorporated into model estimation. Eye-tracking also reveals systematic nonattendance of attributes only by a minority of respondents. Most respondents visually attend most attributes most of the time. We find no compelling evidence that the level of attention is related to respondent certainty, or that higher or lower value attributes receive more or less attention

The measurement properties of the menorrhagia multi-attribute quality-of-life scale:a psychometric analysis

Menorrhagia, or heavy menstrual bleeding (HMB), is a common gynaecological condition. As the aim of treatment is to improve women's wellbeing and quality of life (QoL), it is necessary to have effective ways to measure this. This study investigated the reliability and validity of the menorrhagia multi-attribute scale (MMAS), a menorrhagia-specific QoL instrument. Participants (n = 431) completed the MMAS and a battery of other tests as part of the baseline assessment of the ECLIPSE (Effectiveness and Cost-effectiveness of Levonorgestrel-containing Intrauterine system in Primary care against Standard trEatment for menorrhagia) trial. Analyses of their responses suggest that the MMAS has good measurement properties and is therefore an appropriate condition-specific instrument to measure the outcome of treatment for HMB. © 2011 The Authors BJOG An International Journal of Obstetrics and Gynaecology © 2011 RCOG.

Asset renewal decision modelling with application to the water utility industry

Reliable infrastructure assets impact significantly on quality of life and provide a stable foundation for economic growth and competitiveness. Decisions about the way assets are managed are of utmost importance in achieving this. Timely renewal of infrastructure assets supports reliability and maximum utilisation of infrastructure and enables business and community to grow and prosper. This research initially examined a framework for asset management decisions and then focused on asset renewal optimisation and renewal engineering optimisation in depth. This study had four primary objectives. The first was to develop a new Asset Management Decision Framework (AMDF) for identifying and classifying asset management decisions. The AMDF was developed by applying multi-criteria decision theory, classical management theory and life cycle management. The AMDF is an original and innovative contribution to asset management in that: · it is the first framework to provide guidance for developing asset management decision criteria based on fundamental business objectives; · it is the first framework to provide a decision context identification and analysis process for asset management decisions; and · it is the only comprehensive listing of asset management decision types developed from first principles. The second objective of this research was to develop a novel multi-attribute Asset Renewal Decision Model (ARDM) that takes account of financial, customer service, health and safety, environmental and socio-economic objectives. The unique feature of this ARDM is that it is the only model to optimise timing of asset renewal with respect to fundamental business objectives. The third objective of this research was to develop a novel Renewal Engineering Decision Model (REDM) that uses multiple criteria to determine the optimal timing for renewal engineering. The unique features of this model are that: · it is a novel extension to existing real options valuation models in that it uses overall utility rather than present value of cash flows to model engineering value; and · it is the only REDM that optimises timing of renewal engineering with respect to fundamental business objectives; The final objective was to develop and validate an Asset Renewal Engineering Philosophy (AREP) consisting of three principles of asset renewal engineering. The principles were validated using a novel application of real options theory. The AREP is the only renewal engineering philosophy in existence. The original contributions of this research are expected to enrich the body of knowledge in asset management through effectively addressing the need for an asset management decision framework, asset renewal and renewal engineering optimisation based on fundamental business objectives and a novel renewal engineering philosophy.

Development of a data mining-based analysis framework for multi-attribute construction project information

Data mining techniques extract repeated and useful patterns from a large data set that in turn are utilized to predict the outcome of future events. The main purpose of the research presented in this paper is to investigate data mining strategies and develop an efficient framework for multi-attribute project information analysis to predict the performance of construction projects. The research team first reviewed existing data mining algorithms, applied them to systematically analyze a large project data set collected by the survey, and finally proposed a data-mining-based decision support framework for project performance prediction. To evaluate the potential of the framework, a case study was conducted using data collected from 139 capital projects and analyzed the relationship between use of information technology and project cost performance. The study results showed that the proposed framework has potential to promote fast, easy to use, interpretable, and accurate project data analysis.

Trade determination in multi-attribute exchanges

Electronic exchanges are double-sided marketplaces that allow multiple buyers to trade with multiple sellers, with aggregation of demand and supply across the bids to maximize the revenue in the market. Two important issues in the design of exchanges are (1) trade determination (determining the number of goods traded between any buyer-seller pair) and (2) pricing. In this paper we address the trade determination issue for one-shot, multi-attribute exchanges that trade multiple units of the same good. The bids are configurable with separable additive price functions over the attributes and each function is continuous and piecewise linear. We model trade determination as mixed integer programming problems for different possible bid structures and show that even in two-attribute exchanges, trade determination is NP-hard for certain bid structures. We also make some observations on the pricing issues that are closely related to the mixed integer formulations.

Value Estimation and Comparison in Multi-Attribute Choice

The following work explores the processes individuals utilize when making multi-attribute choices. With the exception of extremely simple or familiar choices, most decisions we face can be classified as multi-attribute choices. In order to evaluate and make choices in such an environment, we must be able to estimate and weight the particular attributes of an option. Hence, better understanding the mechanisms involved in this process is an important step for economists and psychologists. For example, when choosing between two meals that differ in taste and nutrition, what are the mechanisms that allow us to estimate and then weight attributes when constructing value? Furthermore, how can these mechanisms be influenced by variables such as attention or common physiological states, like hunger?

In order to investigate these and similar questions, we use a combination of choice and attentional data, where the attentional data was collected by recording eye movements as individuals made decisions. Chapter 1 designs and tests a neuroeconomic model of multi-attribute choice that makes predictions about choices, response time, and how these variables are correlated with attention. Chapter 2 applies the ideas in this model to intertemporal decision-making, and finds that attention causally affects discount rates. Chapter 3 explores how hunger, a common physiological state, alters the mechanisms we utilize as we make simple decisions about foods.